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ABSTRACT 

Three Army programs in English as a second language 
(ESL) are evaluated. The programs had lengths of 3 weeks, 6 weeks, 
and 6 months. The evaluation was carried out with a standardized 
group test of English comprehension, an individually administered 
test of oral proficiency, questionnaires, observations , followup 
questionnaires and tests, informal techniques, and curriculum 
analysis. Most of the soldiers in the programs v/ere well-educated 
Puerto Ricans with weak oral English skills. The programs' length and 
content varied widely. All three produced gains in English 
proficiency, with gains increasing with the program length. ESL 
training was found to be positively related to lowering of attrition 
rates. Although ESL participants generally liked their programs and 
teachers, they felt the need for more practice in conversational 
skills. Supervisors were generally supportive of the programs and 
made qualitative decisions between soldiers scoring 50 or more and 
those scoring less than 50 on the standardized test. Evaluation 
results suggest a need for greater emphas'is on spoken English, more 
realistic expectations of what can be accomplished in a short time, 
and systematic training of Army ESL teachers. The need for ESL in the 
Army is affirmed, and the possible lowering of the current criterion 
of language proficiency is discussed. (MSE) 
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FOREWORD 



The Instructional Technology Systems Technical Area of the US 
Army Research Institute for the Behavioral and Social Sciences 
performs research and development in educational technology with 
applications to military education and training. A major focus of 
this research is the development of information on which the Depart- 
ment of the Army can base decisions about its Basic Skills Education 
Program. 

This report describes and evaluates three of these programs, all 
related to English-as-a-secoiid-language as taught to Army trainees. 
Data collection was supported by the Office of the Adjutant General 
and the Training and Doctrine Command. 



EDGAR M. JOHNSON 
Technical Director 



8 



ERIC 



EXECUTIVE SUMMARY 



Requlr eoien t : 

To evaluate the effectiveness of /Irmy Engllah-aa-a-seoond- 
language (ESL) prograoia of various lengths and types. 



Procedure : 

Three ESL program3--3ix-week , three-month, and slx-month-- 
were evaluated with a standardized group test of English com- 
prehension, an individually administered test of oral proficiency, 
questionnaires, observations, followup questionnaires and tests, 
informal techniques, and curriculum analysis. Procedures were 
designed with the support of the Adjutant General^s Office and the 
cooperation of the Training and Doctrine Command. 



Findings : 

Most of the soldiers in ESL programs were well educated 
Puerto Ricans whose English speaking skills were weak. The three 
programs differed considerably in their length and content, 
particularly their degree of "functionality." All three programs 
produced gains in English proficiency as measured by the standard- 
ized test. The longer the training time, the greater the gains. 
Oral proficiency data showed that six-week students gaiaed at 
about the same rate as three-month students in some skills but not 
in others. ESL was found to have some positive relationship to 
lowering of attrition rates. Although ESL participants generally 
liked their programs and teachers , they felt the need for more 
practice in conversation skills. Supervisors were generally 
supportive of the programs and made qualitative distinctions 
between soldiers scoring 50 or more on the standardized test and 
those scoring less than 50. 



Utilization of Findings: 

The findings have relevance for scientists and administrators 
in military education and training, and for all personnel who deal 
with limited English proficient soldiers. Implications of the 
results concern key characteristics of ESL programs, the need for 
ESL in the Army, and the validity of typicially used cutoff scores 
on the standardized test of English comprehension. 
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ENaUI3H-A3-A'3}i:C0ND-LANaUAQE PR0QIUM3 IN THE ARMY 



INTRODUGTIQN 

ThU report prea^nfca reaulta Qf an fvaluiUon of |nf i^^-aa-i^ 
aaoond-lanBuagQ (E3L.) fcrainlng programa In fch© Army. TOea© PJ^- 
g?amS a4 pa?t of the Army's BaSlo SkUU Eduoifclon ^^l^^^ ' 

IsL inatpuotlon is offered to soldiers who need greater English 
prof Sienoy to function well in the Army. RSiSi'trare 
la ESL as taught before or during baalo training (BT). Results are 
reported fo? three programs, the standard, six-week ESL Program , 
giJen in 1988 at slk training bases and two one-time, experimental 
DroKram3--one three-month and the other a six-month 
^rog?am!-oon?uated for the Army in 1981-1982 at the D«f«J»;,^«J; 
guage Institute English Language Center (DLIhLC) at Laokland AJr 
Force Base, Texas. 

This evaluation is important because it concerns ESL, which 
becomls increasingly more critical as the ^^^^^ ,f 
proficient persons in the United States grows. It is an example n 
Sultitrait-multimethod research conducted in ^iffioult, ^J^l 
world" settings. It also reflects the Joint efforts of several 
atrencies namely the U.S. Army Research Institute for the Be- 
hlJ?ora?'and locial Sciences (ARI), which conducted the research 
through contract to the American Institutes for Research (AIR); the 
OfficioFthe Adjutant General, which supported the ^-esearch; and 
the Training and Doctrine Command (TRADOC) , which provided essen- 
tial cooperation in many areas of the research. 

The Problem 

The Army estimates that at least 5% of the present enlisted 
force Sas EngUshlanguage comprehension problems. We can expect 
this percentage to increase over the next decades as the armed 
services induct increasing numbers of limited English speakers. 
?ecrius Who have trouble understanding and speaking English fi^ 
it- difficult to complete training successfully. In the i^raining 
e^viromnent language difficulties are associated with many prob- 
lems: culture Ihock, difficulty in following directions and 
understandinR written material, low motivation, and safety prob- 
TemsaccorSing to TRADOC (1982). Similarly, a recent study by the 
Navy found that limited-English-speaking Hispanic !;ecruit3 had 
Mgher attrition rates, reduced promotion potential f"^ decreased 
job efficiency Compared to English-speaking I'^^'^^i^^.^Salas 
Kincaid. & Ashcroft. 1980). These correlates ^ f ^^^^"glJJ"?^ 
nroficiency have high costs for the military. It 

?ind waySto train fimited English proficient recruis so tha they 
can perform well in the armed services, and this training win 
likely involve some form of ESL. 



ERIC 



12 



ESL Approaches; Traditional and Modern 

Traditionally, foreign or second languages were taught as 
grammar and translation courses with more emphasis on reading than 
on communicating. However, the needs of the military the • 
foreign service to produce fluent speakers of foreign languages led 
to the development of intensive courses that emphasized oral rather 
than reading skills. The methods developed in these contexts 
filtered back to high schools and into adult language programs. 
These methods were based on the common-sense principle that, in 
order to speak a language well, one has to practice speaking it 
(Anthony 4 Norris, 1972). 

Drawing on the principles of behavioral psychology, developers 
of foreign language and ESL courses created the audio-lingual or 
aural-oral method. In a purely structural audio-lingual ESL 
course, trainees learn different sentence structures through 
pattern drills. The purely^ structural approach is limited because 
of difficulties in transfer of training from the classroom to the 
"real world" (Crandall, 1979). 

Purely structural ESL gave way to more situational or "func- 
tional" ESL, in which structures are taught and practiced in the 
context of dialogues reflecting situations the trainees might 
normally encounter outside the classroom. Making the situations 
relevant addresses not just transfer of training but also motiva- 
tion (Knowles, 1978; Schumann, 1978). Moreover, functional situa- 
tions provide the opportunity to teach culture as well as language. 
A relatively new development is the movement to a more generalized 
functional curriculum organized around speech acts (e.g., making 
requests, asking for clarification, expressing an opinion) rather 
than based on situations. This is known as a "notational- 
functional" curriculum (Crandall, 1979). 

Carroll's (1967) work on foreign language learning among 
college students is relevant for all types of ESL approaches. 
Carroll found that the major variable influencing f^^^-efsn language 
competence was the amount of time the student was i^e^l^ed in. using 
the language. Research on "time on task" (Denham & Lieberman 
1980) substantiates the importance of the time, factor for academic 
progress. 

Until 1982 the Army's ESL training was mainly structural. In 
1982 a more functional, Army-related ESL course was initiated, but 
the Army has not yet moved to functional-notational ESL. Different 
lengths of programs have been piloted by the Army with an under- 
standing that the time variable might be important. The current 
Research concerns three of the Army's structurally oriented ESL 
programs of varying durations: six weeks, three months, and six 
Sonths. Data will be collected later on the functional ESL pro- 
gram. 
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Evaluation Questions 

In the context of the problem and the ESL approaches described 
above, the investigation focused on five key questions: 



Question 1 : 
Question 2 ; 
Question 3 ' 
Question U : 
Question 5: 



What were the characteristics of students in 
the ESL programs? 

What were the characteristics of the three ESL 
programs? 

Did any of the three programs improve soldiers' 
ability to use English? 

Did any of the three programs result in lower 
attrition rates for soldiers? 

What were the perceptions of ESL students and 
their supervisors toward ESL programs? 
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METHOD 

This section discusses subject, data gathering procedures, and 
statistical analysis. " 

Subjects 

The subject pool consisted of participants in three ESL 
programs, including a six-week regular program, a three-month 
experimental program, and a six-month experimental P!;°8ram (see 
Table 1). The six-week regular program during fiscal yeaf^^ ^979 
throuah 1981 (FY79-81) involved 2,804 prarticipants , for 2,232 ot 
wSori?andardized test dat? are available. A nonmatched comparison 
group consisting of 1,679 eligible nonenrollees was used for some 
analyses. The three-month experimental program involved 151 
soldiers (of whom IMS graduated) and had a "onmatched comparison 
group of 99 soldiers. Comparison group data for the thre«-month 
experiment are not reported here because they are still Being 
gathered. A total of 200 participants (of whom 186 graduated) and 
200 controls matched on ESL eligibility were part of the sij-month 
exoeriment. Some of the control group members received no English 
training in the-Army, while others attended the six-week regular 
course. The control group was pretested at Array entry and ^ 
posttested nine months later. Optimally, posttesting would have 
been six months later, but Array operational schedules precluded 
this. 

3' 
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Table 1 



HuBbdr of Subjaote from Ihraa E8L PrograoB 
Participating in Individual Data Collection Pro.ceduree 



Program 



Siz-veek 



Three- 

month 



Six- 
month 



Oroup 



Treatment group 

Treatment group in follovup 

Unmatched oouparison group 

Treatment group (began) 

(graduated) 
Treatment group in BT® follovup 

Treatment group in AIT8 follovup 

Unmatched compariaon group 
(no follovup) 

Treatment group (began) 

(graduated) 
Treatment group in BT« follovup 

Treatment group in AIT8 follovup 

Matched control group 

Matched control group in follovup 



Total 



2,804* ^ 
1,679* 

151 
148 
116 

113 

99 



200 
186 
132 

98 

200 
175 



Number by procedure 



Oral 

Standardised proficiency 
test (ECLT) teat 
N N 



Questionnaire 



2,232*»^ 
1,679* 
148 



99 
186 



200 
50 



330 



43 



5000 



146 



116 by students 

135 by supervisors' 

113 by students 

95 by supervisors^ 



130 

132 by students 
109 by supervisors* 
98 by students 
36 by supervisors' 



aiRADOC record data, PY79-81. 

^Counts only those vho completed at least five veelcs. 
<:Site visit data, FY82. 
<lAttrition data only. 



^Basic training. 

fSome supervisors had several ESL soldiers* 
EAdvanced Individual Training* 
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Data Gathering Procedures 



The three programs were evaluated with a standardized group 
test of English comprehension, an individually administered test of 
oral proficiency, questionnaires, observations, followup question- 
naires and tests, informal techniques, and curriculum analysis. 
Not all these methods were used for every program, in part because 
the six-month program had been completed before field data collec- 
tion began and in part because the large data base is strictly 
archiv al . 

Standard Group Test of English Comprehension 

All three programs were evaluated through the use of the 
English Comprehension Level Test (ECLT). The ECLT was administered 
before and after the experimental programs, with interim testing 
approximately every two weeks during the programs. For the six- 
week program, the ECLT was given before and after training and, at 
some installations, as a midterm exam. The ECLT was developed by 
DLIELC. For-ns are replaced annually. Each form has 120 items. 
All items are multiple-choice with four possible answers per item. 
Respondents mark answers on a separate answer sheet. Lexical items 
comprise 75% of the test content, and the remainder of the test 
contains structural items. Two-thirds of the.^ test are devoted to a 
combination of listening and reading, and the balance is purely 
reading (DLIELC, 1980). 

The ECLT has high reliability and validity. Internal consis- 
tency and alternate forms reliability are in^the. 80-. 90 range 
(DLIELC. 1980). When correlated with adult basic education tests 
and tests of English as a foreign language, the ECLT has ^^jn^"^^®"^ 
validity coefficient?^ in the .79-. 83 range (DLIELC, 1980; Mebane, 
1980; Oxford-Carpenter, Leopold, & Duvall, 1982). Although the 
perils of language testing' have been clearly noted (Troike , 1 9bi; , 
the ECLT appears to have both psychometric merit and operational 
utility. 

Individually Administered Test of Oral Proficiency 

About one-third v(N=M 3) of the three month group and 1.M% 
(N-33) of the six-week group were chosen to take a newly developed, 
individually administered test of oral language proficiency at the 
beginning and the end of their ESL training. Three-month par- 
ticipants were randomly, selected within each of the three ECLT 
levels to take the oral "test. Soldiers sampled in the six-week 
program were those who entered the program at a given installation 
during the w«ek of the evaluator's first visit; they received the 
oral test as a posttest five weeks later. 
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The oral test was developed by the American Institutes for 
Research (AIR) to determine an individual soldier's skill levels m 
English comprehension and speaking. The test includes overall 
scores for production and comprehension and subscores for fluency, 
pronunciation, grammar, vocabulary, and specific comprehension. 
The test was built on the Foreign Service Institute model but 
includes content relevant to military li^^ /"^I^i^^^^^^f^,, 
Pictorial cues. Preliminary concurrent validity data show that the 
subtests correlate .70-. 89 with the ECLT. Furthermore, pre-post 
sains on the oral test correlate with ECLT gains m the range of 

50- 71 for all subtests except pronunciation and total comprehen- 
sion'. Interrater reliability coefficients for the subtests were 
.75-. 99 for the six-week program sample and .80-. 99 for the three- 
month program sample. 

Questionnaires 

Questionnaires about language proficiency, training, back- 
cround, and attitude were given to soldiers in the six-veek and 
three-month programs. Spanish speakers received questionnaires in 
Soanish. BT drill sergeants and Advanced Individual Training CAIT) 
instructors received questionnaires concerning perceptions about 
soldiers who had participated in the three- and six-month programs. 

Observations 

For the three-month and six-week courses, observations were 
made of instructional settings and techniques _using a standardized 
form. In many instances it was possible to verify observational 
da^a through multiple visits to posts. Although observational data 
were not available for the six-month program, retrospective anecdo- 
tal data obtained through instructor interviews were available. 

Followup 

Each program had some kind of followup. Participants in the 
six-week program in FY79-81 were tracked by records on attrition 
and other variables. A followup of six-month program participants 
involved gathering data from BT and AIT supervisors on soldiers _ 
attitudes! language performance, and training base adjustment. An 
even more elaborate followup was conducted on three-month program 
part ■ Ipants. 

Informal Interviews and Observations 

Informal methods, such as unstructured interviews and field 
notes, were used to supplement formal techniques. Unstructured 
Spanish-language interviews with program participants proved to be 
particularly important. 
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Curriculum Analysis v 

curriculum IT^ments, including f^ructure. texts workbooks, 
tests, and other materials, were analyzed carefully for all three 
programs . 

Statistical Analysis 
Because most of the analyses concerned the total population 
rather'than% sample, and because those "^Plj%;;^3i°;„?rr:nUa? 
were not randomly assigned, descriptive rather than inferential 
statistics were more suitable. 

RESULTS 

The results are presented in the order of the five questions 
listed earlier. 

Qu estion 1: What Were the C haracteristics of the Students 
■ in ihe ESL Programs? 

During FY79-81. at least 4.483 limited English spea*^^"? 
uuring ri(^ oi, elisible for ESL instruction, with 

base and are"nde?esu:";3. 3!"e dita are known to be hissing 

1,500-2,000 soldiers. 

Between 85* and 95% of the Army's ESL students are Spanish 
between vhe«je hail from Puerto Rico. Most of the 

iHSi^ o 5 r^r ?£^ L%^ra%?r./ 

r^^^io 1 r e e b ^i^r^avt-sSired-lnlKsi^jrl^^^aii:! 
distributed over the ESL-eligible range (0-70). 
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Question 2; What Were the Characteristics of the Three , 

ESL Programs? 

In FY82, six continental United States installations— Forts 
Benning, Dix, Jackson, Knox, Leonard Wood, and Sill-rhad regular 
six-week ESL programs for new recruits. Forts Gordon and Bliss had 
operated large programs during FY79-81, but in 1982 they did not 
house BT units and therefore did not have ESL programs. The ESL 
programs varied in size, ranging from Fort Leonard Wood with one or 
two teachers and an average of one soldier entering ESL per week to 
Forts Jackson and Dix with six or seven teachers and an average of 
seven to 12 soldiers entering ESL per week. The six-week programs 
also varied in the emphasis they placed on teaching English lan- 
guage structure versus military information. Although the cur- 
riculum of the six-week programs was supposed to be the American 
Language Course (ALC) developed by DLIELC, over time most instal3a- 
tions replaced or supplemented the ALC with their own lessons on 
military information and with other teacher-made materials. The 
ALC is a standardized, multimodal, oral-aural program which focuses 
mainly on listening, reading, and pattern practice. Soldiers in 
the six-week programs attended class six hours a day, five days a 
week. At some installations ESL students were housed as a group 
with other basic skills trainees in one unit. They were then 
assigned to separate units for BT after completing the ESL course. 
At other installations ESL and other basic skills trainees were 
housed with soldiers who were already in BT; they remained in those 
units until completion of ESL or BT. 

The first of the two DLIELC experimental programs lasted 26 
weeks, or approximately six months, September 1980-March 1981. The 
second experimental program lasted 13 weeks, or approximately three 
months, August-November 1981. For the six-month program, ESL 
training was considered part of each recruit's enlistment obliga- 
tion. Students were selected from a .pool of eligible recruits. 
Eligible soldiers who went directly to the training base served as 
matched controls. Soldiers in the three-month program had to agree 
to extend their service obligation by three months. Both ex- 
perimental orograms were conducted by regular DLIELC teachers using 
the ALC. Soldiers in these two programs were housed as Army troops 
under supervision of Army noncommissioned officers (NCOs) , away 
from Air Force personnel and foreign nationals at Lackland Air 
Force Base. After ESL classes soldiers were treated as a military 
unit and exposed to military topics by their drill sergeants. 
Soldiers attended ESL classes six hours per day (two hours of which 
were in a language laboratory) , five days per week. 
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Question 3: Did Any of the Three Programs Improve Soldiers' 
•— Ability to Use blnglish? 

All three programs produced gains in English Pf'^^J jf!"^^ ' J?"® 
2 shows average weekly ECLT gains and average total ECLT gains for 
the three proirams and for the six-month <^e"trol group As shown, 
participants in all three programs made substantially higher 
average weekly gains (ranging from 1.3 to 1.9 points) than the 
control group (.5 points). The variation in gain for the three 
programs was not great, with participants in the three-month and 
six-week programs achieving approximately equal, average weekly 
sains (1.9 and 1.7 points) and participants in the six-month _ 
program gaining 1.3 points per week on the average. Average weekly 
gain is a convenient and useful metric for comparing programs. 
However, use of average weekly gain does not imply or confirm 
linearity of gain scores across time. It is important to note that 
a ceiling effect may have occurred for six-month program par- 
ticipants, thus suppressing their average weekly gain below that of 
participants in the other two programs. 

The average total gain for the programs indicated, as would be 
expected based on Carroll's (1967) study, that the longer a soldier 
has ESL training, the greater the English Pf^^^i^lf^^y ^ains. The 
average total gain for the six-month program was 31 points for the 
three-month program, 23 points; for the six-week program, 10.2 
points; and for the six-month control group, 18 points. 

Fi(?ures 1 and 2 show that the three- and six-month experimen- 
tal proirams had similar learning curves for different levels of 
- E?LT pritest scores. In other words, average rates of improvemeat^^^^^^^ 
in English proficiency were quite regular for both programs. Gains 
were made by participants in all entry ability levels. 

Results of the oral proficiency test (given to six-week and 
three-month participants) also showed gains in English proficiency, 
is Ihown in Table 3. the six-week students gained on all measures 
except pronunciation, while the three-month students gained on 
every measure. In overall comprehension, grammar, and fluency, the 
six-week stuuents gained at about the same rate as the three-month 
students. On the other parts of the test the f ^"f ^^^f^;!*^^" 
Rained at slower rates than the three-month students. Most six- 
Seek to?al gains were 24% to 50% of the magnitude of three-month 
♦•-.t-ai eains lenorins differences in curriculum, a simple time 
comparison ;ould?ea3'to the expectation that the total gain for 
the six-week program would be 50% of that of the three-month 
program, since the six-week program was half as long^as the three- 
Sonth^rogram. "At this point we do not know if a different type of 
p?Sgram wfuld have produced greater gains in oral proficiency in 
six weeks. " ~ 
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Table 2 

Average ECLT Gains by Program^' 



Program 


N 


r 01 n xs / weeK 


XUudlX UUxliOo ^cix^icu 


Six months (26 weeks) 


185 


1.3 


31 


Three months (13 weeks) 


151 


1.9 


23 


Six weeks^ 


2,232 


1.7 


10.2 


Six-month control^ 


50 


.5 


18 



^Note -that these figures are not to be construed as suggesting that 
all gains were linear. Use of average weekly gain simply provides 
a comparison of programs but does not confirm linearity. 
I^Counting only soldiers completing five or more weeks. (.Counting 
all 2,804 cases in the TRADOC base gives an average gain of 2 
points/week. Soldiers who exit early, however, make unprecedented 
high gains in a very short time. These gains are probably spurious. 
Early exit was not an option in the DLIELC courses, although some 
soldiers reached the maximum score (80+) before the end of the • 
course. In. calculating mean gains for the TRADOC data, we set all 
scores below 30 to 20 to make them comparable with the DLIELC data. 
^Over a nine-month period. 
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Figure 1. Median ECLT scores by testing session and 
initial score level for 3 -month group. 
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Figure 2. Median ECLT scores by testing session and 
initial score level for 6-month group. 
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Table 3 



Oral Proficiency Gains for the Three-Month^ Experimental 

Program Participants and the Six-Week Regular Program Participants 



Oral 
proficiency 
measure 


Three-month 
gains 


Six-vreek 
gains 




Total Weekly 


Total Weekly 


Overall comprehension 
Overall production 
Discrete ratings: 

Vocabulary 

Grammar 

Fluency 

Pronunciation 

Specific comprehension 


11.1 

J ' 4 

1.1 
1 .0 

1 .0 
1 .0 
.8 


.85 

■ ^ u 

.09 
.08 
.08 
.08 
.06 


5.5 .92 
.8 .13 

.3 .05 
.4 .07 
.4 .07 
-.1 -.02 
.1 .02 


a-13 weeks of instruction. 








Table 4 








'ait Failures^ by ECLT Entry Scores for Total Six-Month Experimental 
Program Participants and Control Group Members 






AIT 


failures 


ECLT entry score 


Experimental 


Control 




Percent 


N 


Percent N . 


Below 50 


0.7 


1/144 


8.9 13/146 


50 and over 


0 


0/42 


13.9 5/36 


All scores 


0.5 


1/186 


9.9 18/182 


s^Language and academic reasons only; indicates 
before completing AIT. 

13 ■ 


failed AIT or left 
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For both groups that took the oral proficiency test, overall 
comprehension improved faster than overall production. This is 
consistent with child development literature, which shows that 
production may demand more practice than comprehension and may 
depend on comprehension. 

In interpreting these proficiency data, it is important to 
remember that most students in Army ESL programs were Puerto Ricans 
who had previously studied English in school but lacked English 
speaking skills. Hence, Army ESL training may be considered 
retraining for many or most of the participants. 



Q uestion 4; Did Any of the Three Programs Result 
in Lower Attrition Rates for Soldiers? 

The general answer to this question is that ESL training 
helped participants, especially lower-scoring ones, to stay in the 
Army. Attrition is defined here as failing AIT or leaving anytime 
before completing AIT. Findirgs for the six-month program are 
shown in Table 4. When six-month participants were compared with 
the matched control group, <. trition was far greater for the 
control group (9.9J) than f the experimental group (0.5%). 
Similar comparative data ai ^t yet available for the three-month 
program. For the six-week , o -am. Table 5 indicates that the 
percentage of soldiers who failed cr left before completing AIT was 
about the same for participants and eligible non-participants. 
Furthermore, soldiers who entered the six-week program with higher 
ECLT scores enjoyed no advantage over those with lower entry 
scores. According to these findings, then, the six-week program 
had no apparent effect on training base attrition; yet other data 
(shown in Table 6) provide some evidence of an influence of the 
six-week program on attrition. Table 6 indicates that higher ECLT 
gains are associated with lower attrition for the six-week program, 
participants, and lower gains are linked to higher attrition. In 
sum, ESL participation clearly affected attrition rates for six- 
and three-month program students. 



Question 5: What Were the Perceptions of ESL Students and 
Their Supervisors Toward ESL Programs? 

There were mixed but generally positive perceptions about the 
three programs among students and their BT and AIT supervisors. 
Highlights of the questionnaire results are presented below. 
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Table 5 



AIT Failuresa by ECLT Entry Scores for ^ix-Week Program 
Participants and Eligible Nonpart icipants in PY79-81 Data Bas 



e 



ECLT entry score 



AIT failures 



Participants 



Percent 



N 



Eligible nonparticipants 



Percent 



N 



Below 50 
50 and over 
All scores 



6 

5 
6 



135/2,132 

33/672 
168/2,804 



6 
2 
5 



62/1 ,034 
16/645 
78/1 ,679 



aLanguage and academic reasons only; indicates failed AIT or left 
anytime before completing AxT. 



Table 6 

ATT, Pailuresa by ECLT Gain for Si x-Veek ESL Pro gram Participant^ 



ECL gains (points) 



None 
1-15 
>15 
Totals 



Percent 

13 
6 

3 



N 

61 /462 
77/462 
30/984 
168/2,804 



aLanguage and academic reasons only; indicates failed AIT or left 
anytime before- completing AIT. 
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Pe rceptions About the Six-Week Regular Program 

More than 90? of the participants said that their English^had 
improved at least a little since they joined the Array, at which 
time they began their Array ESL training. More than 90% said their 
teachers care about their learning English ^^-^ ^o help thera, 
and 80% said they like the way their teachers teach ESL. Most stu- 
dents (76%) expressed good feelings about the overall ESL program. . 
Almost all students (95%) who corapleted the course expressed 
■Greater communicative corapetence than they felt when they entered 
the Army. However, alraost all students (92t) also reported the 
need to improve speaking and understanding English. They Perceiyed 
speaking to be their greatest weakness and felt that .they received 
too little training in speaking and listening. Even after five to 
six weeks of training, nearly half the students rated themselves as 
"poor" or "not at all" in speaking English, and two-fifths rated 
themselves -imilarly in understanding spoken English. Eighty-five 
percent said they needed more chances to practice speaking EnSlisn 
in cLss, and nearly 90% said they did not g«t e"S"f,\PPJ^^.""^^^^" 
to talk with English speakers. Respondents attributed their 
English improvement more to encaunters with English speakers 
outside of class than toclassroom activities, particularly at 
posts where ESL students were' billeted with English .speakers. 

Perceptions About the Three-Month Exper imental Program 

As in the six-week program,, most soldiers who participated in 
the three-raonth program wanted raore instruction in conversation 
skills and less instruction in reading English. Understanding 
spoken English was the highest need expressed^by these soldiers 
.Xiv_.followed up in BT (5 6%0 r J^hn^peaking EngU 
highest need they mentioned in AIT^6r%). In both BT and AIT, 
supervisors' ratings closely reflected exit ^CLT scores of sol- 
diers. Soldiers scoring 50 and above on the exit ECLT tended to 
receive higher ratings by BT and AIT supervisors for understanding, 
speaking' reaSing, and writing English than did soldiers who scored 
less thin 50 on the exit ECLT. BT and AIT supervisors rated ESL 
soldiers higher in speaking and understanding English than in 
reading and writing English. This may be explained by the fact 
that these supervisors did not have-much opportunity to 

Observe soldiers' heading and writing skills. In contrast to their 
supervisors, ESL soldiers rated themselves as least competent in 
loelking English in both BT and AIT. In BT they felt themselves 
mos? colpetlit in reading English, and in AIT they ^aid they were 
most skilled in understanding classroom- lectures. Supervisors gave 
high ratings to .the motivation of ESL participants. 

Perceptions About the Six-Month Experimen tal Program 

Six-raonth program graduates who had exit ECLT scores below 50 
were Tar rao?e likely to be rated by AIT instructors as "extremely 
Hmited" ?n English speaking and understanding than were graduates 
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with 50+ exit ECLT scores. Specifically, 23% of the below-50 
gra5ua?es iere considered extremely H^ni^ediQ understanding and 
in of the below-50 were considered extremely limited sP^akinS, 
compared to H5 and 2% of the 50+ graduates. BT drill sergeants- 
ratings were in the same direction, but the difference between 
below-50 and 50+ was less pronounced. 

Summary of Results Across Questions 

Most of the soldiers in ESL programs were well e<^"°3ted Puerto 
Ricans whose English speaking skills were weak. Programs differed 
considerably in their length and content (particularly in their 
degree of "functionality"). All three programs that were inves- 
tigated produced gains in English proficiency as measured by the 
ECLT The longer the training time, the greater the gains. Oral 
proficiency data showed that six-week students gained at about the 
saSe rate as three-month students in some skills but not in others. 
IIl was found to have some positive relationship to lowering of 
attrition rates. Although ESL participants generally liked their 
programs and teachers, they felt the need for more Practice in 
conversation skills. Supervisors were generally supportive of the 
p?ogr^s anS made qualitative distinctions between soldiers scoring 
50 Ir more on the ECLT and soldiers scoring less than 50. 

POLICY IMPLICATIONS 

This section- presents three main policy i"iPli°ations. First, 
Army ESL programs Seed to be based on certain key characteristics 
suggested by theory and resWarchT Secondy que^ti^r^^^^ n^ed 

ESL can be answered only if several considerations are in- 
eluded^ ?Sird, ?Se Jllidity of the ECLT exit score of 70 needs to 
be examined further for various Army uses. 

Characteristics Needed in Army E SL Programs 

The programs evaluated had mildly positive ^^^^^ ' Ji^^^"^ 
ESL theory suggests that changing to a more functional program 
m?ght produce^Su^h more dramatic resi;lts. 1"^'?''"^^^^^" ^J^^ J^J, 
interviews observations, and questionnaires also indicates that 
A?my ESL p^ogrlms might be improved by gj-^ater emphasis on teaching 
SDoken English; realistic expectations about what can be ar;hieved 
?S a given amount of time; and systematic training of Army ESL 
teachlrstraost of whom have not taught ESL before contracting to 
teach for the Army. ' 
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Need for ESL in the Army 



Four factors affect the need for ESL in the Army: 
demographics, ecomomics, evaluation, and ethics. Demographics show 
that there is a large ESL-eligible population in the Army. The 
high Hispanic growth rate will increase the number of recruitment- 
age Hispanics in the next few decades. Some individuals argue that 
if the recession continues, the Army will have such a large pool of 
eligible recruits that it will no longer have to induct limited 
English proficient soldiers at all. However, if the economy 
improves and the pool of eligible English speaking recruits shrinks 
due to availability of nonmilitary jobs, the Army may find once 
more that it needs high caliber, limited English proficient sol- 
diers who can be trained in ESL. In that case, good ESL training 
would be essential for the Array. Program evaluation data also 
relate to the need for ESL. As seen in this report, English 
proficiency levels can be improved through ESL training in as short 
a time as six weeks, and the longer the training time, the more 
improvement can be made. Evaluation data also show effects of ESL 
on attrition and perceptions. Finally, the ethical factor relates 
to the need for ESL. It may not be ethical to deny some Americans, 
such as Puerto Ricans, the opportunities for career development 
that the Army offers because those Americans do not speak English 
as their native language. 

Validity of ECLT Exit Score of 70 for the Army 

The Army has implicitly accepted DLIELC's criterion of English 
language proficiency: an exit score of 70 on the ECLT. DLIELC 
developed this standard over years of erapirTcal-testlng wi th 
foreign nationals. The Array needs to investigate whether the 
criterion of 70 is relevant to its own uses. That score may be 
relevant to some ESL soldiers and not others—depending on their 
Array jobs, their ability to coramunicate nonverbally, and the 
assistance network available through peers and supervisors. Data 
should be gathered on the predictive utility of any proficiency 
score in terras of performance on the job. Some of the data 
presented above indicate that 50 is a criterion that might be 
relevant for some Array uses. However, lowering the PfoJi^Jency 
standard from 70 to 50 could have a negative effect on trainees 
long-term opportunities in the Army by pushing ESL soldiers^out of 
the program before they have received maximum benefit. It must 
also be noted that any proficiency standard is s^mew^^a^ a^^^^^^^Ji^y » 
and human judgment is involved in the process of determining who is 
a competent English speaker and in what situations. Empirical data 
will help make these judgments more rational in the Army setting 
and will be particularly important if the Army ever develops an 
open exit program based on attainment of a particular criterion 
score. 
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CONCLUSIONS 



This report presents background on the Army's language problem 
and on ESL approaches. It also offers research questions concern- 
ing three Army ESL programs, procedures in evaluating the programs, 
results of the evaluation, and implications. General conclusions 
are that ESL is a necessary and worthwhile training effort for the 
Army and that its effectiveness could be enhanced by considering 
optimal program characteristics and reasonable proficiency stan- 
dards for ESL participants. 
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